Synchronous Subsequentiality and Approximations to 

Undecidable Problems 


Christian Wurm 

cwurmOphil. hhu. de 
Universitat Dusseldorf 


We introduce the class of synchronous subsequential relations, a subclass of the synchronous rela¬ 
tions which embodies some properties of subsequential relations. If we take relations of this class as 
forming the possible transitions of an infinite automaton, then most decision problems (apart from 
membership) still remain undecidable (as they are for synchronous and subsequential rational rela¬ 
tions), but on the positive side, they can be approximated in a meaningful way we make precise in 
this paper. This might make the class useful for some applications, and might serve to establish an 
intermediate position in the trade-off between issues of expressivity and (un)decidability. 


1 Introduction 

Automata play an important role for a huge number of tasks, ranging from formal language theory to 
program semantics and model checking for logical languages. The most widespread applications have 
been found for finite automata; their properties and advantages are well-known to an extent which makes 
comments unnecessary. There can be several reasons to move from finite automata to infinite automata: 
in formal language theory, it is expressive power, same holds for automata as program semantics (a 
program might have at least in theory infinitely many possible states). There might also be another 
reason: for model checking, if we can compute a finite automaton directly from some formal (logical) 
language specifying the properties of the model (see for example f^i]), 1. the resulting automaton might 
be too big to be effectively stored, or even if we can avoid this, it might happen that 2. though the 
resulting minimal automaton is manageable in size, its construction involves intermediate steps with 
automata too large to handle. For overview and motivation in logic, see [8|; in program semantics, this 
problem is referred to as state explosion problem, see fTl. 

So there are a number of reasons to use infinite automata. Their obvious disadvantage is that we 
cannot simply write them down, as they are infinite objects. What we rather do is the following: we 
specify a recursive procedure by which an automaton constructs its own state set on the fly, meaning it 
“constructs” a certain state only when reading a certain input. This leads to the theory of infinite automata 
(see ifT^ for an overview, |21,i6] for some important results), and it is this line of research on which we 
will investigate here. To specify a class of infinite automata, the main work lies in specifying a class of 
possible primitive transitions relations, which are associated with the input letters, and, maybe of less 
importance, classes possible sets of initial and final states. 

For classes of infinite automata, there is usually the following situation of trade-off: Choice 1: we 
take a class of relations which is very restricted, such as typically relations corresponding to transitions 
of pushdown automata (henceforth: PDA) or slight extensions thereof (see for example [4]). In this 
case, problems such as whether one state can be reached from another one, and whether the language 
an automaton recognizes is non-empty are decidable. The problem is that many computations cannot be 
simulated by these transitions, and recognizing power remains quite limited. Choice 2 is that we take a 
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rather expressive class of relations such as the rational (or regular) relations, computed by (synchronous) 
finite-state transducers. These will provide sufficient expressive power for most purposes. But on the 
downside, most problems - reachability of states, emptiness of recognized language etc. - are undecid- 
able. In between these two choices, there is usually thought to be little to gain (see also ifT^ . f9’]). In 
particular, for classes of relations which do not have PDA-style restrictions, undecidability strikes very 
quickly, so there is little use in investigating expressive subclasses of the rational relations. 

Yet this is exactly what we will do here: we will investigate the class of synchronous subsequential 
relations, a rather large subclass of the regular relations, which embodies some properties of subse¬ 
quential rational relations. It comes as no surprise that also for this class, the reachability problem is 
undecidable. Yet this class allows for an interesting way of approximating the reachability problem. 
This in turn allows to approximate other decision problems, which might make this class interesting for 
some applications. The notion of approximation we use is of some interest in itself: its intuitive meaning 
is that we get arbitrarily close to a solution of our binary problem, but we might never reach it. In a 
binary problem, this is of course less satisfying than in a numerical one. However, this can be put to use 
in various ways, which correspond to various interpretations we can give to reachability problems. 


2 The General Setup: Self-constructing Automata 

2.1 The Algebraic Setting: Self-constructing Automata 

One can present automata in many different ways, the most standard one being probably the following: 
an automaton as state-transition system (STS) is a tuple 21 = {L,Q,5,F,1), where £ is a finite input 
alphabet, Q a set of states, d F Q xT. x Q a transition relation, F C. Q a set of accepting states, I C 2 the 
set of initial states. As our main interest will be in infinite automata, we cannot simply write down Q\ 
same for 8 and maybe /,F. The solution to this is simple: we define QFQ.* for some finife alphabef Q. 
inductively by 1. / C Q, and 2. if ^ G 2, a G £, fhen 8{q,a) C 20 and 3. nofhing else is in Q. Nexf, we 
simply define 8 as some compufable relafion, 1,F as recursive sefs, and we have a finife specificafion of 
an infinife sfafe machine. 

As in order fo define an infinife STS, fhe main work lies in specifying fhe fransifion relation, we now 
infroduce a more genuinely relational perspecfive, which amounfs fo a sort of non-sfandard definifion of 
aufomafa, which we dub self-constructing automata, for short SCA. This is more a notional innovation 
than a substantial one, and we just adopt it for convenience. 

Self constructing automata can be roughly conceived of as mappings from the free monoid (£*, •, £) to 
the monoid {p{0.* x Q.*),o,idnt), where Q.* is the free monoid over fl; o denotes relation composition; 
idci* denotes the identity relation on fl*. We call the former the outer algebra, the latter the inner one. We 
will as much as possible stick to the convention of using £ if something is supposed to belong to the outer 
algebra, and Q. otherwise, though both designate finite alphabets throughout. We define a semi-SCA as 
a fuple (£, 0), where 0 is a map 0 : £ —> p{Q.* x Q.*), fhus mapping leffers in £ onfo relations over fl. If 
is extended fo sfrings in fhe usual fashion, where 0 (aw) = 0 (a) o 0 (w); so ^ is a homomorphism from 
fhe outer algebra info fhe inner algebra. A word w G £* from fhe oufer alphabef fhen induces a relafion 
<p{w) C fl* X fl*. We call fhe relations of fhe form 0(a) : a G £ fhe primitive transition relations. To 
get a full automaton, we still need an accepting relation of initial and accepting states. One usually 
specifies a single initial and a set of accepting states, yielding an accepting relation {xq} x F. As for 
us, acceptance will only play a minor role, we will take a slightly more general convention and assume 

'Here and throughout this paper, we treat relations as functions into a powerset whenever it is convenient. 
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that SCA specify an accepting relation C Q* x Q*, which might be a Cartesian product, but need 
not be. We denote the accepting relation by Fr, where the subscript is just a reminder that we have a 
relation rather than a set of accepting states. Thus a full SCA is a tuple (Z, ^,Fr). We can now define the 
language recognized by an SCA. Let 21 = {'L,^,Fr) be an SCA; then L(2l) := {w G Z* : ^(w) CiFr^ 0}. 

For convenience, we always put ^{e) = ida* (though this is not necessary in all cases). One might 
at this point wonder how we deal with e-transitions. There is an easy solution to that, by changing 0. 
Before we state it, we give the following definitions: Given a set of relations {/?; : i G /}, I an arbitrary 
index set, by {/?,•: i G /}® we define fhe smallesf sef such fhaf: 

1. {F,:/G/}C{/?,:/g/}®; 

2. ifR,R' G {Ri: i G 7}®, fhen 7?o/?' G {Ri : i G 7}®. 

3. ida* G {7?;: i G 7}®. 

In words, {7?,- : i G 7}® confains {7?,- : i G 7}, fhe identify, and is closed under composition. [—]® is 
obviously relafed fo fhe Kleene-sfar closure, buf for composition of relations rafher fhan for concafenalion 
of sfrings. Be also careful fo keep in mind fhaf we do nof fake fhe union over fhis closure, so {7?, : i G 7}® 
is not a relation buf a sef of relafions. We will sometimes refer fo a sef of fhe form {7?, : i G 7}® as a 
relation monoid, as if is easy fo see fhaf Ibis sef is a monoid wifh operafion o. We will also need fhe 
union of fhis sef and so define {7?;: i G n® := U(R : i G 7}®). This is nof exacfly fhe smallesf reflexive, 
fransifive relafion confaining every 7?, : i £ I, because if confains fhe full identify on G*; aparf from 
fhis however if equals fhe reflexive fransifive closure. We urge fhe reader fo be careful fo nof confuse 
{7?,: i G 7}®, a sef of relafions, wifh {7?, : i G 7}®, a relafion. Now assume we wanf a relafion Rg fo 
correspond fo e, whereas for each letter a G Z, we wanf a corresponding relation Ra- We can simulate 
this in the algebraic setting by putting (p{a) := (Rg)® oRa o (7?e)®. 

Given some classes of relations by we denote the class of all semi-SCA (Z, ^), where 

for all a G Z, ^(cj) G By we denote the class of all SCA (Z, where 0(cj) G and 

Fr G ^ 2 - A class of SCA is a class of the form for some classes of relations 

2.2 Decision Problems in the Relational Setting 

The most important decision problems in this paper can be states as follows: 

Reachability problem: Given a class of automata 5^, is there an algorithm, which for any {'L,^,Fr) G 
dF, {x,y) G G* X G*, determines in a finite number of steps whether there is w G Z* such that (x,y) G 
^(w)? 

Emptiness problem: Given a class of automata is there an algorithm, which for any given automaton 
21 G ,5^ determines in a finite number of steps whether 7.(21) = 0? 

Inclusion problem: Given a class of automata is there an algorithm, which for any given automata 
2l,2t' G .5^ determines in a finite number of steps whether 7.(21) C L(2f')? 

If fhere is such an algorifhm, we say fhe problem is decidable for dF, if fhere is no such algorifhm, we 
say if is undecidable. Note fhaf in mosf cases (if dF confains fhe class of finite aulomala), fhe inclusion 
problem subsumes fhe empfiness and universalify problem, as fhey amounf fo decide whefher 7.(21) C 0, 
Z* C L(2t). Obviously, fhere is a close connecfion befween empfiness, reachabilily and recursiveness of 
relation monoids; if is made precise by fhe following lemma: 

Lemma 1 Let FIN the class of finite relations. Given a class of relations M, the following are equiv¬ 
alent: 

1. The emptiness problem for A decidable. 
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2. The reachability problem for decidable. 

3. Every relation of the form {Rj : i € /}®, where \ i ^ I, |/| < (0, is recursive. 

Proof. 1^2: Take a semi-automaton {E,<p), and ask whether there is w G £* such that {x,y) G <p{w). 
This is the case if and only if L{{L,(j),{{x,y)})) / 0, which by assumption is decidable. 

2^3: Assume the reachability problem for .5^^ fin is decidable, and for /?,• G / G I, |/| < ft), ask 
whether {x,y) G ({7?, : i G 7})®. We just put L := 7, 0(7) = Rj. Then we know whether there is w G 7* 
such that {x,y) G 0(w), which holds if and only if {x,y) G ({7?,- : i G 7})®. 

3 1: Ask whether for (Z, G h{{L,(j),F]i)) = 0. We take {{(j){a) : a G Z})®, which is 

recursive by assumption. Now we have L((Z, 0,Fs)) = 0 if and only if for all {x,y) G F^, {x,y) ^ {{^{a) : 
a G Z})®. As Fr is finite, this can be effectively checked for all members. H 

Of course it is a rather significant restriction to only consider finite accepting relations. But keep in 
mind that for many (most?) automata, we can boil it down to this case without loss of recognizing power, 
provided we allow £-transitions|l 


3 Synchronous Subsequential Relations 

3.1 Synchronicity and Subsequentiality 

The intuitive notion of synchronicity is that we use finite-state transducers which do not have e-transitions. 
A (finite-state) transducer is a tuple {Q,'L,F,qQ,5), where F C Q, qo £ Q, Q,L are finite, and 5 C 
Q X ZU {e} X ZU {e} x Q. Transducers are based on the operation •, where {a,b) ■ {c,d) = {ac,bd). We 
extend 5 to 5 by 5{q,a,b) = 8{q,a,b), and d{q,aw,bv) = {5{cf ^w,v) : q' G 8{q,a,b)}\ L(2t) = {(w,v) : 
5(^0)M^a) / ®}- If ^ is recognized by a finite state transducer having transitions of the form (e,a) 

and/or (a,e), then it is rational. The main advantage of synchronicity is that without £ appearing in 
components, the operation • still gives rise to a free monoid: each term has a unique maximal decom¬ 
position. This property gets lost with £: (a,£) • {£,b) = {£,b) ■ {a,e). So this means that synchronous 
transducers can be reduced to simple string automata for most properties, whereas transducers in general 
cannot. 

However, under this strict definition disallowing £-transitions, the corresponding relations are rather 
useless for infinite state transition systems, as from each state, only a subset of the finite set of equally 
long states is reachable. So one uses a more liberal definition: we allow £-transitions to occur, but only 
if in the component in which they occur, there are no more other letters to come. By |w| we denote the 
length of a string, by its k iterations. Put := U {-L}, for Q.. The convolution 0(w, v) of a 
pair of strings (>v,v) G fl* x fl* is defined by ©(wjv) := So in simple 

words: we lake Ihe shorler word of Ihe Iwo and add X-symbols lo make if as long as fhe ofher. The 
convolufion of a relalion R C is defined as OR := {0(w,v): (w,v) G 7?}. A relalion R CQ.* xTl* 
is regular, if Ihere is an (£-free) finile slale fransducer over (f2_L)^ recognizing QR; we denofe Ihis class 
by REG. This is fhe notion of synchronicity we will use here. Regular relations as defined here form a 
proper subclass of fhe relafions defined by finile sfafe Iransducers in general, bul fhe reslriclion comes 
wifh a huge gain: REG is closed under Boolean operations, whereas fhe rafional relations are nol closed 
under intersection and complemenf (see lUl). This makes fhe regular relafions fhe more nafural choice 
for application for example in logic (see ifTTI l. 

^We need not talk of FSA, but this holds also for PDA,TM and many intermediate classes. 
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It is easy to see that ^reg has an undecidable reachability problem, as Turing machine ttansitions 
are regular. A highly non-trivial result shows that recognizes exactly the context-sensitive 

languages (proved in ifTOl l. 

The intuitive notion of subsequentiality is the following: relations on strings are subsequential, if 
computations depend on prefixes that have already been read, but not on the part of the input which has 
not been read yet (in the sequel, we refer to this as “future”)- It is easy to define this concept for rational 
relations: let T = {Q,L,5,qo,F) be a transducer (possibly using £-transitions) which is total, that is, for 
every a ^'L,q ^ Q, there is some {q,a,a' ,q') G 5. Then T is subsequential, if Q = F. In this sense, 
there is no way to discard any computation we have made so far. A relation R is subsequential if it is 
computed by some subsequential transducer. We denote this class by SUB. The reachability problem for 
S^suB is again undecidable. Though this result is not literally stated at any point we know, it easily falls 
off from results in [2i| (who prove that iterated subsequential transduction generates languages which are 
not recursive). Moreover, as below we show a stronger result (theorem |9l), we omit the formal statement 
and proof of this one. What we now do is to pair the concept of subsequentiality with the concept of 
synchronicity. 


3.2 Synchronous Subsequential Relations 

It is not reasonable to simply define a synchronous subsequential relation as being computed by a syn¬ 
chronous transducer with only accepting states: because in this case still computations depend on “the 
future”: simply because whether we can map (or read) some £-pendant _L depends on the symbols which 
are still to come (as _L can only occur final); so in some cases, we would have to discard computations 
which have been executed, which contradicts the essence of subsequentiality. So we have to use another 
definition of synchronous subsequential relations, taking a detour over (one-sided) infinite words. Let 
Q. be an alphabet; we denote the set of infinite words over Q. by fl®; formally, we can think of them as 
functions N —> fl; so they have the form aia 2 ...a„...: we have a first letter, every letter has an immediate 
successor, and every letter is preceded by finitely many letters. For clarity, we will designate infinite 
words with x,y etc. Furthermore, we need one special letter □, which we assume to be in all our al¬ 
phabets Q. over which we form infinite words (please read this as a dummy for an arbitrary letter, which 
however has to be explicitly designated). We can get back from infinite words to finite words via the 
following map 

{ aiT](a 2 ...an..), if 02 -..an--- ^ and 

£ Otherwise. 

So for X G fl®, ri(x) G Q* iff all but finitely many letters are □, and rjix) =x otherwise. We now 
complete our definition of synchronous subsequential relations as follows: let T := {Q,5,L,qQ) be a to¬ 
tal (wrt. input q,a) £-free transducer without accepting states. We put L®(‘X) := {{a\a 2 ----,b\b 2 ---) F 
fl® : 5{qo,a\,b\,q) G 5, and for all i G N, there is some q G 5{qo,ai-.-ai,bi---bi) and q' such that 
{q,ai+i,bi+i,q') E 5}. We say T is synchronous subsequential, if for every vv E fl®, if ri(w) G Q*, 
(w,v) E L®(T), then T](v) G fl*- We thus want for any input with a finite T] -image the output to have 
a finite T]-image as well. Technically, this can be easily implemented by making sure that after some 
number of input of D-symbols, we end up in states which only give □ as output given a D-input. Call 
these states final (not to be confused with accepting). The motivation for this definition is the follow¬ 
ing: we can use infinite words with finite T]-image as if they were finite words (in the sense of effective 
computation). 


ri{aia2---an---) = 


Definition 2 Wh say that a relation R C fl® x OF is in SyS, the class of synchronous subsequen- 
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tial relations, if there is a synchronous subsequential transducer T such that R = {(w,v) : (w,v) € 
L«(T)&T](W)ea*}. 

The trick is the following: as we do not have accepting states, there is no additional complication 
when considering infinite words as opposed to finite words, as complications arise from mode of accep¬ 
tance. As we do not have any £-transition, if we restrict ourselves to have a finite input (modulo rj), that 
is sufficient to ensure we have a finite output (mod rj). Note that □ plays a double role in this definition: 
if it is followed by some other symbol a 7 ^ □, then it is a symbol just like any other. If it is followed by 
□-symbols only, it basically plays the role of _L in the regular relations, that is, it is a dummy-symbol 
mapped to e. Note that this “trick” is necessary to pair synchronicity with subsequentiality, as we do need 
a dummy symbol which gets deleted if final, and af fhe same fime we need fo ensure fhaf fransifions are 
fofal. An easy way fo undersfand fhe relafion of finile/infinile words is by analogy wifh fhe real numbers: 
a number as 3.05 is in some sense a “shorfhand” for fhe number 3.050000...; we can cuf away final Os, 
buf only if fhere is no ofher number fo come. 

For purposes of practical compulation, Ihis oscillalion belween finite and infinite words does nol pose 
any problem: we can jusf fake a finile inpuf word w and fake all fhe oufpufs we reach wifh some inpul 
wD” wifh which go fo a final slate. The resulfing sef of oufpufs (mod rj) is exaclly fhe oulpul for fhe 
infinife inpuf word wD®. So if we have a specific finite inpul word, we can compute fhe oulpul by means 
of a finite Iransducer wifh some accepling slales (corresponding fo fhe final slates). However, Ibis does 
not hold in fhe more general case where we have an infinite sef of inpuf words. This is because when 
reading an inpuf wD”, which is a prefix of an infinife word vv, we can never be sure whefher rj (vv) = w, 
so we can never aclually slop fhe compulation. This happens for example in relafion composition, and 
one mighl consider Ibis problemalic. However, in Ihis case we cannol wrile down fhe sef of oufpufs 
anyway; and so we have fo compule a finile represenlalion of fhe infinite oulpul sef (or relafion). The 
mosf imporfanl lemma fo ensure applicabilify of SyS for infinite aufomafa is fhe following: 

Lemma 3 IfR,R' G SyS, then RoR' € SyS. 

Proof. We can easily show Ihis by fhe slandard Iransducer conslrucfion: given synchronous rational 
fransducers 2 li = ( 21 , 11 ,^^, 5i ),212 = ( 22 ,^ 2 ,we simply conslrucl 2 I 3 = ( 2 i x Q 2 ,{qo,ql),'^\C 
£ 2 , 53 ), where 5^ is defined as follows: {(q,r),a,b, (a'r')) G ^ 3 , iff {q,a,c,q') G 5i and {r,c,b,r') G 82 . If 
can be easily checked (by induclion on word lenglq^ lhal Ihis conslrucfion works. H 

Lemma 4 SyS C REG. 

Proof. 1. C. Assume R G SyS. Take fhe synchronous subsequenfial Iransducer T recognizing R. 
Make an additional, disjoinl copy of fhe final slales lhal is 1. accepling, 2. absorbing (no leaving arcs ) 
and 3. where you change □ fo ±. This is synchronous and does fhe job. 

2. 7 ^. Every finile relafion is synchronous. A finile relation which is nol synchronous subsequenfial 
is {{aac,aa),{aad,ab)}. This is because SyS-fransducers have fo be fofal, and if we compute a prefix 
{aa,aa), we have an inpuf teller d, fhere musl be some oulpul word corresponding fo inpuf aad. H 

By pref{w) we denofe all prefixes of w. Relafions in SUB generally have fhe prefix property: if 
(>v,v) G R, Ihen for every w' G pref{w), fhere is v' G pref{v) such lhal {w',v') G R (proof is slraighlfor- 
ward). SyS does nol have Ihis properly, as we see below: 

Lemma 5 SyS % SUB 

^One might correctly observe that an induction is insufficient for the case of infinite words. However, we can reduce this 
case to the finite case as sketched above. We skip details as the construction is standard. 
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Proof. Take simply a relation R whieh eomputes the identity on all words in {□, a}*, whieh end with 
a. Obviously, R G SyS; to see that R ^ SUB, just note that R does not have the prefix property. H 

The underlying reason is given by the sketeh above: up to some extent, the eomputations of a syn- 
ehronous subsequential transdueer depend “on the future”, namely as regards the question whether □ is 
mapped to e or not. SUB ^ SyS is obvious, as SUB % REG. Note moreover that in the ease of a one-letter 
alphabet, all SyS-relations over this alphabet are trivial. 


3.3 SyS and Program Semantics: an Example 

To exemplify the meaning of SyS-relations in terms of eomputational power, let us give the states of 
infinite automata the following interpretation: A state, being a finite string, represents a eurrent state of a 
program. This program state in turn is a veetor eontaining values of all deelared objeets (this eomprises 
all variables, memory, registers, program eounters ete.). We ean thus think of regions of the string as 

value of xi boundary value of X2 

values of variables. For example, we might have 0102 ^ ’’"a^ 05 !?^ .... Now assume the program 
eomputes the following funetion for all i sueh that x,+i is a deelared objeet: 


:= 


if xi,...,Xi satisfy eondition Ci 
ifxi,...,x, satisfy eondition C 2 


where /i,/ 2 ,.. are more basie eomputations and Ci,C 2 ,... are exhaustive. This kind of eomputations 
is exaetly what relations in SyS do. An intermediate sequenee of □ symbols ean be thought of as 
saying: “variables are not instantiated”, just giving them some default value. We ean thus perform 
eomputation steps where the eomputation on variable depends on the values of (and eomputations 
performed on) earlier variables, but not on those whieh have higher index. This is due to the restrietion 
to subsequentiality. The restrietion regarding synehronieity eoneerns a restrieted ability to insert new 
variables into the existing order (it is elear that the order of variables is of erueial importanee in this 
model): in one eomputation step, we ean insert only a globally bounded number of new variables into 
the existing hierarehy, but not a arbitrary number (say, after any existing variable, insert a new one into 
the hierarehy). Moreover, it poses some bounds to value ehanges of variables. 

We ean thus say: A^reg corresponds to eomputations where values of all variables are eomputed in 
dependenee of one another, PDA eorrespond to eomputations where only one variable ean ehange value 
in the eourse of a eomputation step. ,5^SyS then eorresponds to the intermediate situation where there 
is a linear hierarehy (i.e. sequenee) of variables, where the eomputations of variables higher up in the 
hierarehy (i.e. having lower index) have impaet on eomputations on lower variables, but not viee-versa. 
So there are some restrietions; still it is easy to see that a huge number of eomputations ean be performed 
in this way! 


4 Some Formal Properties of SyS 

We now serutinize some more properties of SyS. We denote by o the produet of two infinite strings, 
whieh is defined as follows: (aia 2 ....)o(^i^ 2 ---) = So if w G v G (^^ 2 )®, then 

wov € (fli X 0 . 2 )^- We lifl Ibis operations fo sefs in fhe eanonieal fashion and exfend if eanonieally fo 
relations, sueh fhaf = {((vox'), (yoy')) : (x,y) G R, {x',y') G R'}. If is easy fo see fhaf we eould also 
define fhis operafion for finife words, buf if would require some additional definilions fo “synehronize” 
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them. There is one thing we have to take care of: we have used a symbol □ with a special meaning in 
the definition of SyS. We define a map /□, which is a sfring homomorphism defined by /n(n, D) = D, 
and /n (.r) = x ofherwise. Again, we liff fhis map fo sefs and relations in fhe canonical fashion. A simple, 
yef imporfanf lemma is fhe following: 

Lemma 6 lfR,R' G SyS, then fu{RoR') G SyS. 

Proof. TakeTi = (Q,Zi,^o, 3 i ),‘^2 = (R,^ 2 ,ro,S 2 ). We pul T 3 = (QxR,fo(^i x I 2 ), (^o,?‘o), 
where 63 is defined by: ((q,r),/ij(a,h),fn(a',h'), (q'jr')) G S 3 iff (q,a,a',q^ G Si,(r,b,b',r') G Sj. This 
is a sfandard consfrucfion for FSA, so we leave ifs verificafion fo fhe readerO H 

Lemma 7 Let SLt \, be classes of relations. If are closed under o, then the class of languages 

L(,5^i ,^ 2 ) closed under intersection. 

Proof. We can show fhis by consfrucfion: fake 21i := (ri,(/>i 2 I 2 :— {'L2,(j)2,FR2)- Wilhoul loss 

of generalify, we assume fhaf Zi = £ 2 !! We consfrucf a new automaton 2 I 3 := (Zi, {(pi, (j) 2 ), {Fri oFr 2 )), 
where {(pi,(p 2 ) '■ Zi — {Q.i x 0 . 2 )^^ x (fli x fl 2 )“ is defined by {(pi,(p 2 ){w) = (pi{w)o(p 2 {w). If is easy to 
see lhal £( 213 ) = L(2li) nL(2t2). H 

If is also easy fo see fhaf in parficular fhe class FIN of finife relafions is closed under o. Moreover, 
regarding SyS, fhe map /□ does nol affecf recognizing power, so if remains a fechnical delail we will 
ignore in fhe sequel. Nexf we prove fhe following: 

Lemma 8 Let L be a CFL. Then there is a%G .^^SyS.FiN such that L = L(2t). 

Proof. We show how fo encode a PDA in SyS. The argumenf is conceplually simple yef fedious in 
full formalify, so we give a rafher informal explanation. 

We encode slacks (and conlrol slales) as slrings, and assume we read Ihem from bottom to fop. 
Moves which consisl in pushing somelhing onlo fhe stack are unproblematic: we just have to make sure 
that after reading (x,x) we have a transition (njy), and this is sufficient if we make sure for all reachable 
states that if we encounter □ at some point, then only □ is to follow in that component. 

The problem comes with pop-moves: reading x from left to right, we cannot tell whether a certain 
symbol is final in ri(x). We Iherefore proceed as follows: a sel of popping PDA-lransilions {{xa,x) : x G 
LI*,a G fl} is encoded by a sel of Iransilions {{xab\b 2 ...,x\F\c\C 2 ...) :x G LI* and for all i G N, if bi 7 ^ □, 
Ihen c, = ■ and c,- = □ ofherwise} (where ■ does nof figure in fhe original slack alphabef). This relation 
is clearly in SyS. Nole fhaf for all slafes nof confaining ■, fhis preserves fhe properly fhaf if we encounter 
□ al some poinl, Ihen only □ is to follow in lhat componenl. 

Thereby, we use ■ as an “absorbing symbol”, fhaf is, a symbol which can never be eliminaled from 
a siring, and which does nol figure in any accepfing slale of fhe aulomalon 21 G =5^SyS.FiN- We use if fo 
exclude all Iransilions which do nol correspond fo “well-formed” slack moves from reaching an accepting 
slate. This creafes some addilional non-delerminism wrf. fhe PDA, buf makes sure all H-free slafes have 
been reached by legilimale PDA-moves. H 

These lemmas, laken logelher, already have a strong immediate consequence: 

Theorem 9 Given Rf G SyS : i Gl, |7| < CO, it is undecidable whether {x,y) G {Ri: i G /}®. Equivalently, 
the reachability problem for .5^SyS A undecidable. 

very similar construction is performed when constructing the automaton recognizing the intersection of two regular 
languages. 

^We can always enlarge alphabets with a new letter CT, putting = 0. Of course we have to assume 0 is in any class of 
relations. 
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Proof. Assume conversely the problem is decidable. Then equivalently, the problem whether L(2t) = 
0 is decidable for all 21E .i^SyS.FiN- Now we take two context-free languages Li,L 2 , accepted by two PDA 
by empty stack. We encode the two PDA into 2ti,2t2 E =5^SyS,FiN- By lemmaHl we have 213 € -5^SyS,FiN> 
such that L(2l3) = L(2li) nL(2t2). By assumption, we can decide whether L{%^) = 0, which holds if and 
only if Li nL 2 = 0. But this is well-known to be an undecidable problem for two context-free languages 
- contradiction. H 

Corollary 10 The emptiness, universality and inclusion problems for undecidable. 

So we do have a negative result for reachability in the first place. The proof also tells us how powerful 
SyS is despite its restrictions, as we can recognize any intersection of context-free languages, and so if 
we allow e-transitions, we can already recognize every recursively enumerable language (it is also well- 
known that by simulating two pushdowns we can easily simulate a Turing machine). However, we can 
show that there is a way to approximate its decision problem in a way to be made precise. 

5 Decompositions and Approximations 

We define the maps : n E N by T:n{a\a 2 ...,b\b 2 ...) = {an,bn). For R a relation, we put T„(/?) = 
v) : (vv, v) E R} (again, for simplicity we give the definition only for infinite words). Note that is 
not necessarily a homomorphism for relation composition: Put/?i = {{ab...,ba...)},R 2 = {{bb...,aa...)}■, 
then Ti (7?i) oTi {R 2 ) = {(a,a)}, whereas Ti(/?i 0 R 2 ) = 0. However, we have one inclusion: for all n E N, 
R,R' E {Ri : i E /}®, o/?') C t„(7?) o as is easy to see. 

These notions are related to the notion of direct and subdirect decompositions, fundamental to uni¬ 
versal algebra (see Q). We can say a set {Ri : / E /} is directly decomposable, if for all n E N, is 
a o-homomorphism for {/?, : i E /}®, and in addition, Y\n<(o{'^n{{Ri '■ i € f)®} = {Ri ■ i £ (here, H 
refers to the operation • - the pointwise concatenation of pairs - which is extended to sets). We can say 
{Ri : i E /}® is subdirectly decomposable, if for all n E N, is a o-homomorphism. One can readily 
check that this is sufficient for the usual conditions of (sub)direct products to hold. We also define the 
related family of maps a„ : n E N by a„(]c,y) = flLi The main motivation for considering SyS 

is the following result: 

Theorem 11 Assume (r, (^) E S^SyS- Then for all n E fl,a,b E Tl,x,y E Tl*, the sets {w E £* : {a,b) E 
T„((/)(w))} and {w E r* : (x,y) E a„(0(w))} are regular languages. 

We prove this only for a, as the two proofs are almost identical. If we have a function / : M —)• A, 
then for X CM, we write f[X] := {f{x) : x EX}. 

Proof. Take an arbitrary fixed n. For x,y E D®, we write T y, if T = zx',y = zy' with |z| = n. 
This is obviously an equivalence relation. The notion of synchronous subsequentiality now allows for 
the following argument: If T x', then for any w E L*, we have {x,y) E 0(w), if and only if we have 

{x',y') E (/>(w) for some y' : y' y. Moreover, if T y,y y', then an{x,y) = On{x',y'). 

By this, we can obtain a congruence: Define by (w) = [<p{w )]that is, the set of ~„- 

equivalence classes of 0(w). It is then clear that we have a„ o (p{w) = CT„ o 0.^^(w), if we choose an 

arbitrary representative for each equivalence class. Moreover, the monoid infinite, simply be¬ 

cause fl® modulo has only finitely many equivalence classes. So is a map from Z* into a finite 
set of relations, and hence for every element, the pre-image consisting of the words mapped to relations 
containing this element, is a regular set (this is a fundamental result of the algebraic theory of finite 
automata, see |Tj). Hence {w E Z* : {x,y) E a„(0(>v))} is regular. H 

To see how a, T are connected, consider that we have 


Christian Wurm 


67 


{w G I* : {ai...an,bi...bn) G a„((/)(w))} = ^ L* : G T;(0(w))} 

As regular languages are closed under intersection, we thus obtain a regular language for any finite 
sequence of indices. Moreover, the emptiness, universality and inclusion problem for regular languages 
are decidable, and our computation effective. We now take the following convention: given x,y £ Q.*, 
we put fa){x,y) = {{xx,yy) '.x,y £ fl®, T] (l), T] (y) G fl*}. Then the main result on approximation reads: 

Corollary 12 For any (r, 0) G ^SyS> {x,y) G fl* x fl*, the set {w : 0(w) £\fo){x^y) / 0} is a regular set 
which can be effectively computed. 

This means that we can approach the problem of emptiness/reachability by calculating the language 
for longer and longer prefixes of the infinite pair (]c,y), which yields smaller and smaller regular lan¬ 
guages. SyS can be characterized in another very natural fashion: 

Lemma 13 Let {/?,• : i £ 1} be a set of relations, such that for all i £ I, £ SyS. Then (Jn({Fi : i £ 
;>®)) = (<!,[{«,■ :i£;}])®. 

Proof. Follows directly from the conditions of synchronicity, subsequentiality and totality. H 

This is in some sense the essence of synchronous subsequentiality. The converse implication of 
lemma [T3] is however wrong: just take any singleton set {/?}, where FoF = 0. This satisfies the above 
equation, and it is easy to find /? ^ SyS for this. 

6 The Limits of Approximation 

One might think that this allows for effective approximation of the reachability problem in the sense 
that if {x,y) ^ {<p{a) : a G L}®, then there is some finite (x,y) such that {x,y) £ fco{x,y) and {<p{a) : a G 
r}® r\f(o{x,y) = 0. In this case, the approximation would always succeed in the case that actually (x,y) ^ 
{^{a) : a £ L}®, the only problem being that we never know whether it is still worth continuing the 
approximation. So the situation would be similar to a recursive enumeration (as opposed to a terminating 
decision procedure). Unfortunately, this is wrong, and we want to underline this fact to not give a 
misleading impression of the power of the methods developed here: 

Theorem 14 There exists (£, 0) G ^SyS, (^u). such that 1. (x,y) ^ {^{a) : a £ Z}®, and yet 2. for every 
finite prefix (x,y) = a„{x,y), {0(a) : a G I}® n/co(x,y) 0. 

Proof. Assume that the above claim is wrong, which means: if ix,y) ^ {0(a) : a G Z}®, then there 
is a pair of finite strings {x,y) = On{x,y) and fco{x,y) n {0(a) : a £ Z}® = 0. We show how to construct 
a decision procedure for checking the reachability problem out of this fact, contradicting theorem |9] 

We have a recursive enumeration of {0(a) : a £ Z}®. So we can by turns enumerate an element 
of {0(a) : a £ Z}®, and compute {w : 0(>v) Cf(a{x,y) 0} for a growing prefix (x,y) of (T,y). By 
this method, either at some point we will find (x,y) in our enumeration, or we will, for some finite 
(x,y) G (fl*)^, find thaf {w : 0(w) n/o(x,y) / 0} = 0, meaning thaf {0(a) : a £ Z}® r\fa){x,y) = 0. This 
entails that {0(a) : a £ Z}® is recursive - contradiction. H 

This is a negative result, but keep in mind we have never promised a decision procedure, just a 
method for approximations! Now we can also state more precisely what it means for us to approximate 
a binary problem: if {x,y) ^ {0(a) : a £ Z}®, then the set of candidate strings will diminish for a„{x,y) 
as n increases; so we get closer to the empty set, though it is not said we reach it after a finite number of 
steps (theorem |9ll. Note that we can still be more precise: the reachability problem is undecidable only 
if for all n G N, |{w : 0(>v) nG„{x,y)}\ =oo (otherwise we can easily check by brute force). 
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Now there is one substantial concern which has to be addressed: could it be that approximations of 
the above kind are trivial, in the sense they can always be performed in one way or another? Assume 
we want to check whether (3c, y) ^ {(^(a) : a G Z}®. Then we just take an enumeration of £*, and check 
for each w whether (x,y) G This way, we get a growing set of strings we can exclude, and in the 

limit, we find a solution to our problem. There is however a substantial difference between this kind 
of approximation and the method we are proposing: if {x,y) ^ {<p{a) : a G Z}®, the latter enumeration 
method can never succeed, because after any finite number of steps, we will necessarily remain with an 
infinite set of strings to check. So because this method comes with no hope of success, it is completely 
useless. On the other side, in our case, we know that approximation can succeed: because each step of 
approximation excludes a possibly infinite language of candidate strings. This does of course not mean 
that it necessarily succeeds: then it would be a decision procedure. This is, in other words, what we 
mean by an approximation to the binary problem of reachability, and this is the meaning of our results. 
We try to make this more precise in the following section. 

7 The Prospects of Approximation 
7.1 Three Potential Applications of Theorem III] 

Apart from this negative result, there are many upsides to our notion of approximation. In particular, 
there are three different ways to “interpret” theorem [TT] which are based on different interpretations 
of states, namely as atomic entities, as encoding objects in a space with a real-valued distance, and as 
vectors of values of program variables. One should keep in mind that sketching methods for SyS, they 
are a fortiori applicable to transition relations which can be simulated by SyS such as those of pushdown 
automata and many other methods in use. 

The first interpretation of the notion of approximation is based on states as discrete objects. Given 
a semi-automaton (Z,0), a relation R, we put X^{R) '■= {w G Z* : ^(w) fl/? / 0}. Given an SCA 
21 = (Z, G ^SyS,FiN> we can use the methods described here to approximate L(2t) (note that the 
restriction that G FIN is not strictly necessary, as is finite anyway, but it simplifies things). We 

can obviously compute /» oa„[T)?]. We then know that for any {L,^,Fr) G =5^SyS,FiN, o is 

a regular language which is effectively computable (a finite union of regular languages). Consequently, 
the sequence {X(j) {fa ° 0'«[?y?]))«GN is a decreasing sequence of regular languages, each containing L(2l); 
thatis, ;K^(/(Boa„[FR]) Q X(l>{fcoOOn+i[FR]) CL(2l) for all n G N. 

Definition 15 Given an SCA 21 = {L,^,Fr), we define its n-approximation 2t„ = (Z, 0,/(o o a„[T)?]). 

This kind of approximation is of course of little interest if we consider the membership problem, 
which is decidable for =5^SyS,FiN anyways. However, it might be very interesting as soon as we consider 
problems which are undecidable for =5^SyS,FiN- In the prior examples, we have focussed on reachability; 
emptiness is related in the obvious way stated in lemma [T] But we can also consider problems like 
inclusion and universality. As basically all important decision problems are decidable for the regular 
languages, we can obviously compute these problems for arbitrary approximations 2l„. So we get the 
following in a straightforward fashion: 

Lemma 16 Given 21,21' G ^SyS.FiN. we can decide whether L{^„) = 0, L(2l„) = Z*, L(2t„) C L{%{j)for 
arbitrary n G N. 

This is clear because all are regular languages we can effectively compute, and we approximate all 
these decision problems in this sense. What we have to show is that these approximations are arbitrarily 
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precise: let (L„)„gN be adecreasing sequence of languages, that is L„ D L„+i. We denote by limn^co{L„) 
the unique language L such that 1. for all n gN, L, and 2. if for all n € N, L„ D L', then L' C L. This 
language always exists, and can be simply defined as {w : Vn G N : w € L„} = The following 

lemma establishes the desired correlation: 

Lemma 17 = L(2l). 

Proof. 5 is obvious, as for all n G N, L(2l„) ^ L(2l), and is the largest language 

satisfying this condition. 

C: assume (x,y) G /o o for all n G N. After some finite number of positions (say k), all letters 

in (x,y) are □, and for (x',y') G the same holds (say after k! positions). Consequently, if the two 
agree on the first max{k,k'} positions, they will agree on all. Hence, we will have (x,y) G Fr, and if for 
all n G N, 0(w) fl/o o o„[Fr] / 0, then (/)(w) nF« / 0; consequently, if w G L(2l„) for all n G N, then 
wGL{%). H 

Note however that this limit-construction does not need to preserve any computational properties: 
we can easily construct a decreasing sequence or regular languages (L„)„gN such that is not 

recursively enumerable: let L C £* be a language which is not recursively enumerable, put L\ = £*, and 
L„+i = Lfi — {w} for some w G L„. Then for all n G N, L„ is a co-finite language and therefore regular, 
whereas //m„_^oo(L„) = L. 

We now sketch how we might use this approximation to introduce a limit value which has some 
similarity to a probability, though the values involved are clearly not probabilities in a technical sense. 
We let denote the inclusion problem, such that = 1 if L(2l) C L(2l'), and J^(2t,2t') = 0 

otherwise. As we have said, this allows us to encode the problem of emptiness and universality. We can 
now simply define a limif for sfepwise approximafion as follows: 

= 1) = linin-^oo (pj-Qvided fhis limif exisfs) 

Thaf is, fhe chances fhaf has a posifive answer would be defined as fhe limif of fhe cardinalify 

of numbers < n where if has a posifive answer for 2t„,2l'p divided by n. 

Nofe fhaf if is nof said fhaf our limif gives fhe correcf answer fo fhe problem: fake fhe case of St©, 
which is an automaton {L,<p,Q) recognizing fhe empfy language, and 21 G =5^SyS.FlN^ which is such fhaf 
1. L(2t) = 0, and 2. for all n G N, L(2t„) ^ 0 (fhis automaton musf exisf, ofherwise empfiness would 
be decidable). Now if we consider ,^^(21,21®), we find fhaf for all n G N, =..^(2t„, (2l0)„) = 0, hence 
L/m(c^( 21 , 210 )) = 0, whereas ,^(21,210) = 1. So fhe limif does nof necessarily coincide wifh fhe correcf 
answer fo fhe problem! 

However, in fhe case of universalify, fhings work ouf beffer: lef 2 I 2 :* be a finife aufomafon such fhaf 
L(2t5;») = £*, and hence for all n G N, L{(9ix.*)n) = Lef 21 be jusf any aufomafon in .5^SyS.FiN- h is 
easy fo see fhaf in fhis case, we have Lim{^,^)) = J^(2l2:*,2t). This is due fo fhe facf fhaf in our 
approach, we always approximafe from fhe fop. We can slighfly generalize fhis concepf: 

Definition 18 An instance of the inclusion problem ,^(21,21') is correctly approximated, ifLim{j^{9i,9i')) 
exists and Lim{J^{9i,9i')) = J^(2l,2l'). 

Lemma 19 Let 5^ be a finite SCaJ^ Then the problem J^(5,2l) is correctly approximated, whereas 
J^(2l,5^) in general is not. 

Proof. The second parf already follows from fhe counferexample above. For fhe firsf parf, consider 
fhaf for some k G N and for all n > k we have L(5 h) = L{^). So if J^(5,2l) = 1, fhen for all n > k, 
d^{dn,'^n) = L and so Lim{jT{^,9l)) = 1. 


®By this, we mean an SCA such that ()>[£] is finite (mod 77 ). This is obviously equivalent to a finite state automaton. 
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Conversely, assume Lim{J^,iX)) = 1. Then if w G L{^), then w G L(2l„) for all n G N. As L(2l) = 
it follows that w G L(2l), so J^(5,2l) = 1. H 

Note that by this result, we have a fortiori the negative result that cannot be correctly 

approximated in the general case where 21,21' G c5^SyS,FiN- Moreover, in this case it is not clear whether 
the limit even exists. From the fact that the universality problem can be correctly approximated, it follows 
that even if the limit exists, in general it is not computable. We can, however, compute L/m„(c^(2l,2l') = 
1 ) = ^ ^ ^^y^ might be able to reasonably estimate the chances that 

a certain instance of the inclusion problem has a certain answer, at least if the problem is correctly 
approximated. 

To make clear what about these results is peculiar to SyS, we should add the following: we can 
provide limit constructions for approximations of reachability for any recursive class of relations, for 
example by taking the limit of reachability with words of length < n. The difference of this approach to 
the ones we sketched here is that the former are always confined to finite stringsets; we never make the 
step to infinite languages approximating the target language. This is a fundamental shortcoming, as we 
can never talk about infinitary properties. On the other side, the two methods might be combined: as we 
have seen, our approximation of languages is always “from the top”, proceeding to smaller languages, 
whereas a concept as “reachability with words of length < n” always comes from the bottom. 

The following two interpretations of theorem [TT] are more genuine to SyS, and there is no way to 
get similar results without the fundamental properties of synchronous subsequential relations. We first 
provide an interpretation of states which allows for a numeric approximation. It is based on the concept 
of state-strings being allocated in a space, where for each two strings we have a unique real-valued 
distance. A distance function on Q.* is any function f : Q.* x Q.* ^ Mq , such that f{w,w) = 0 for all 
>v G fl*, and f{w,v) = f{v,w). A distance function measures how close a string w is to another string v. 

This is a very general notion; we will consider more restrictive distance functions for the set {rj (vv) : 
w G fl®}. By gcp(w,v) we denote the greatest common prefix of w,v, that is, gcp{aw,av) = a{gcp(w,v)), 
and gcp{aw,bv) = e if a b. A normal distance function on fl* is defined as follows: 

1. fhere is a map val : —>■ M, such fhaf if □” G pref{w), □” ^ pref{v), fhen val{w) > val{v). 

2. For sfrings w,w',v, if |gcp(>v,v)| > \gcp{w',v)\, then dist{w,v) < (iAt(w',v) - thaf is, fhe longer fhe 
common prefix, fhe smaller fhe disfance. 

3. If V = wx, fhen dist{w,v) = val{x). 

Note thaf 3. implies fhaf val{e) = 0 and dist{£,w) = val{w). Therefore condition 1. only applies fo 
An easy example of such a measure is if we lef words represenf real numbers in [0,1] (in |fl|-ary 
represenfafion). We simply specify a linear order < on Q.. Then val is jusf fhe map from fhe represenfa- 
fion fo fhe number if represenfs, and dist{x,y) is defined by \val{x) — val{y)\. Note fhaf our definition is 
independent on the order < in fl! Given a normal distance measure dist, we call a convex region of Q.* 
a set of words M, such that M = {w : dist{v,w) < x for some v G Q.*, x G M}; we also say M has center 
V. The following properties are easy to see: 

1. For every normal distance function dist, n G N, vv G fl®, Tj [f^y o a„(vv)] forms a convex region in 
the space defined by dist. We call such a space a normal subspace of fl*. 

2. Given two normal subspaces X,Y C fl* and (r, 0) G ^SyS^ ^ is a regular language. This 
follows from theorem [TTl which is basically a statement on normal subspaces. 

3. For any two x,y G Q.*, (^,0) G ^SyS^ we can effectively compute the language ^ for 
arbitrarily small normal subspaces X,Y with center x and y, respectively; moreover, this language 
is regular. 
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So there is an interpretation where our notion of approximation is very useful: if we consider a string 
as representing a unique numeric value, we cannot determine whether the system can reach value y from 
value x; but we can determine, for any £ > 0, whether we can reach the interval \y — e,y + e\ from the 
interval [x — e,x + e]. But of course, approximation works in scenarios which are much more general 
than the interpretation of strings as real numbers. What is particularly interesting about this approach is 
that it provides a numeric approximation in a purely symbolic setting. 

There is a third interpretation which is based on the encoding of program semantics as strings. As 
we have said, in order to be able to model a program in terms of relations in SyS, we need a linear 
hierarchy of variables which can be thought of in terms of importance: because influence goes only in 
one direction, the more to the left a variable is encoded in the string, the more important it is. Now 
the approximation means: we reach the desired configuration at least as regards the n-most important 
parameters, for n —)■ oo. Moreover, we can effectively compute the set of sequences of computation steps 
which yield this result. 

7.2 Complexity Issues 

There is one most fundamental problem regarding the complexity of our approximation techniques, 
which is the following: given a finite set R C SyS of relations, what is the complexity for computing 
a„[R®]? On the positive side, we know from lemmafTfilthat a„[R]® = (a„[R])®; so the problem is surely 
computable, as a„[R] is a finite set of finite relations. a„[R] is rather easily computed in some way or 
other; the difficult thing is to compute the composition-closure. As a„(/?) is always a finite relation, 
this will be computable in a finite number of steps. The problem is to find the smallest n such that 
Um<n{^; • * ^ S The bad thing is that this n depends on the size of M, where M is 

the underlying set from which tuple components in the relation are taken. For example, consider the 
relation St = {{n,n+ 1) : n € N,n < k} for some k € N. This is a finite relation; still to get {^j;}®, we 
need no less than k iterated compositions. In our case, the underlying set is fl" for some alphabet fl, and 
it is easy to see that this grows exponentially by factor |fl| in terms of n. So assume for all 7? € R, we 
have 7? C X fl)*; then in the worst case, in order to compute a„[R]® we need at least |fl|" computation 
steps. Note that this is only the most fundamental of all problems, which is necessary in order to compute 
for example {fcD o a„ [Fr] ) etc. This is where the notions of direct and subdirect product become in¬ 
teresting, as for relations relations being (sub)directly decomposable, the approximation is much easier. 
This is however beyond our current scope. 

The fact that computing approximations is exponential in terms of n is discouraging, so our prelim¬ 
inary results may not be fully satisfying. Still, in practical application many problems are not as hard 
as in theory (which always takes the worst case). In the theory of infinite automata, there is a necessary 
trade-off between expressiveness on the one hand and decidability issues on the other. Our notion of 
SyS relations and results on approximation, other than exploring the space of possibilities, might serve 
to establish some reasonable position in between the two. 


8 Conclusion 

In this paper, we have introduced the class SyS of synchronous subsequential relations and investigated 
its properties for the theory of infinite automata. SyS covers many possible models of computation, 
such as simple or embedded stacks (as in ifTSll ) and many more. The underlying intuition is that there 
is a linear hierarchy of program variables such that computations performed on higher variables affect 
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computations on lower variables, but not vice versa. Though automata with primitive transitions relations 
in SyS have an undecidable reachability (and emptiness, universality and inclusion) problem, there is a 
way to approximate the problem which does not seem to work for more expressive classes such as the 
regular or subsequential relations, as it presupposes both a 1-1 correspondence of input- and output- 
letters, and independence of computations of later computation steps. The method in itself seems to be 
of some interest and is not necessarily bound to SyS (though it requires some fundamental properties 
of SyS), so one might further investigate on it. We have given a sketch of how one might compute 
the chances that an instance of a decision problem has a certain answer, and how the problem can be 
approximated in the sense of numeric distances and the hierarchy of program variables. Finally, the 
methods presented here are based on (algebraic) decompositions of relation monoids. There seems to be 
rather little work in this vein, so we hope the application of (relation-)algebraic methods to the theory of 
infinite automata, to which we have laid some fundamentals in this paper, might open the road to further 
interesting results. 
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